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IN THE CLAIMS: 

Please CANCEL claim 58 without prejudice or disclaimer and AMEND the claims in 
accordance with the following; 



1-10. (CANCELLED) 

11 . (PREVIOUSLY PRESENTED) A method for simulating manipulation of an object 
utilizing a displayed image of the object, said method comprising the steps of: 

sensing touching contact relative to the displayed image of the object, the touching 
contact simulating a manipulation of the object and outputting touch information corresponding 
to the sensed touching contact and changes of the touching contact; 

detecting, from the output touch information, characteristics of said touching contact 
including the selected location on the object image of the touching contact and changes of the 
touching contact and recognizing therefrom the corresponding object manipulation simulated 
thereby; and 

changing the display of the object image in accordance with the recognized, simulated 
manipulation of the object and object information for the displayed object image, including data 
relative to a type of the displayed object, specifying physical properties of the object, 

12. (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising, in response to detected characteristics indicating that two touching contacts are 
located at opposite sides of the object image and move and stop with a distance therebetween: 

controlling the display of the object image on the display device so that the object moves 
on a display surface of the display device from where the two touching contacts are located at 
opposite sides of the object image to where the two touching contacts stop with the distance 
therebetween. 

13. (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising, in response to the detected characteristics indicating that the touching contact 
position is located at the object and moves while keeping in contact with the object and the 
object is sufficiently large relative to, and extends beyond, the display or only a portion of the 
object image is displayed on the display device: 

controlling the display of the object by scrolling the object image while displaying same. 
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14. (PREVIOUSLY PRESENTED) A method according to claim 13, further 
comprising in response to the detected characteristics indicating that a moving, touching contact 
stops moving: 

controlling the display of the object image on the display device so that the scrolling of 
the object image stops on the display. 

15. (PREVIOUSLY PRESENTED) A method as recited in claim 11 , further 
comprising storing information specifying a position of a portion of the object image being 
displayed on the display device, relative to the whole object image. 

16 (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising, in response to the detected characteristics indicating that the touching contact is 
located at a geometric center or at a center of gravity of the object and moves and stops while 
maintaining contact with the object: 

controlling the display of the object image so that the object image moves from where the 
touching contact is located at the geometric center or the center of gravity to where the moving, 
touching contact stops moving. 

17, (PREVIOUSLY PRESENTED) A method according to claim 11 , further 
comprising in response to the detected characteristics indicating that the touching contact is 
located at a position off a geometric center or off a center of gravity of the object and moves and 
stops while maintaining contact with the object: 

controlling the display of the object image so that the object image moves while rotating, 
from a position where the touching contact begins to a position where the touching contact 
stops. 

18, (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising, in response to the detected characteristics indicating that the touching contact 
touches the object after moving in a direction toward the object, from a position apart therefrom 
and at a first speed higher than a predetermined speed: 

controlling the display of the object so that the object image moves a distance in the 
direction and at a second speed proportional to the first speed with which the touching contact 
touches the object. 
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19. (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising, in response to the object information specifying the displayed object to be of a 
Tollable type: 

displaying the object image in a rolling condition. 

20. (PREVIOUSLY PRESENTED) A method according to claim 19, further 
comprising, in response to the detected characteristics indicating that the touching contact 
touches the object image; 

moving and stopping while maintaining contact with the object, displaying the object 
image in a rolling condition, 

21 . (PREVIOUSLY PRESENTED) A method according to claim 1 9, further 
comprising, in response to the detected characteristics indicating that the touching contact 
moves on the object while maintaining said touching contact with the object: 

displaying the object image in a rolling condition and changing a positional relationship 
between the object image and the touching contact on the object image in accordance with the 
movement of the touching contact on the object. 

22. (PREVIOUSLY PRESENTED) A method according to claim 19, further 
comprising: 

displaying the object image in a rolling condition so as to move the object image in a 
direction of the movement of the touching contact on the object. 

23. (PREVIOUSLY PRESENTED) A method according to claim 1 1 , further 
comprising: 

displaying the object image in a state of distortion and/or restoration, according to the 
object information specifying the displayed object to be of an elastic type. 

24. (PREVIOUSLY PRESENTED) A method according to claim 11, further 
comprising: 

sensing an amount of pressure applied to the object image and, when the detected 
characteristic of the touching contact exceeds a specific amount of pressure, displaying the 
object image in a degree of distortion and/or restoration according to the amount of, and 
changes in, pressure of the touching contact. 
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25. (PREVIOUSLY PRESENTED) An image display and manipulating method, 
comprising: 

displaying an image of an object; 

sensing touching contact relative to the displayed object image and outputting 
corresponding touch information; 

detecting, from the received touch information, characteristics of the touching contact, 
the characteristics including the position on the object image of the input touching contact and 
changes of the position of the input touching contact; and 

changing the display of the object images in accordance with the characteristics and 
object information including an object type, which specifies physical properties of the object. 

26. {PREVIOUSLY PRESENTED) A method according to claim 25, further 
comprising detecting changes of the position of the input touching contact. 

27. (CURRENTLY AMENDED) A method of manipulating a displayed image of an 
object, comprising: 

displaying an image of the object; 

detecting a position of touching contact relative to the object image and changes of the 
touching contact; and 

changing the display of the object image in accordance with the-detected characteristics 
and object information including at least an object type which specifies physical properties of the 
object and position information which specifies a position of the displayed object image. 

28. (PREVIOUSLY PRESENTED) A method according to ciaim 27, further 
comprising detecting changes of the touching contact. 

29. (PREVIOUSLY PRESENTED) A method of manipulating a displayed image of an 
object, comprising: 

sensing characteristics of a touching contact relative to the displayed image of the object, 
the characteristics including at least a position of the touching contact and changes therein, and 
outputting corresponding touch information representing a simulated movement of the object 
responsive to the characteristics of the touching contact; and 
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recognizing a type of manipulation of the object image in accordance with the information 
representing a simulated movement of the object and an object type specifying physical 
properties of the object and, correspondingly, manipulating and displaying the object image. 

30. (PREVIOUSLY PRESENTED) A method according to claim 29, further 
comprising sensing changes in the position of the touching contact 

31. (PREVIOUSLY PRESENTED) A method as recited in claim 30, further 
comprising storing information specifying a position of a portion of the object being displayed, 
relative to the whole object. 

32. (CURRENTLY AMENDED) A display method comprising: 
producing a display of an image of an object; 

sensing touching contact relative to the displayed object image, simulating an actual 
touching contact with an actual object corresponding to the displayed image of the object; 

detecting characteristics of the touching contact including a position of the touching 
contact relatively to the object image and changes of the position of the touching contact; and 

changing the display of the object in accordance with the-object information, specifying 
physical properties of the object, and the detected characteristics, 

33. (PREVIOUSLY PRESENTED) A method according to claim 32, further 
comprising detecting changes of the position of the touching contact. 

34. (PREVIOUSLY PRESENTED) A computer readable medium storing therein a 
computer program affording simulated manipulation of an object in accordance with an image of 
the object displayed on a display surface of a display device, said computer program comprising: 

a first function of responding to sensed touching contact relative to the displayed image 
of the object, simulating a manipulation of the object, and to changes in the touching contact for 
producing and outputting corresponding touch information; 

a second function of detecting, from the output touch information, characteristics of said 
touching contact including the selected location on the object image of the touching contact and 
changes of the touching contact and recognizing therefrom the corresponding object 
manipulation simulated thereby; and 
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a third function of changing the display of the object image in accordance with the 
detected characteristics of the touching contact, the recognized, simulated manipulation of the 
object and object information for the displayed object image including data relative to a type of 
the displayed object specifying physical properties of the object. 

35. (PREVIOUSLY PRESENTED) A computer readable medium according to claim 
34, wherein, in response to said second function detecting characteristics indicating that two 
touching contacts are located at opposite sides of the object image and, further, move and stop 
with a distance therebetween, said third function changes the display of the object image so that 
the object moves on a display surface of the display device from where the two touching 
contacts are located at opposite sides of the object image to where the two touching contacts 
stop with the distance therebetween. 

36. (PREVIOUSLY PRESENTED) A computer program product for controlling a 
computer, the program product comprising: 

a recording medium readable by the computer; 

means responsive to touching contact, and to changes in the touching contact, relative to 
an object displayed on a display surface of a display device, simulating manipulation of the 
object, for producing and outputting touch information corresponding to the sensed touching 
contact and representing the simulated manipulation of the object; 

first subroutine means, responsive to the output touch information, for detecting the 
characteristics of the touching contact and recognizing therefrom the corresponding object 
manipulation simulated thereby; and 

second subroutine means for changing the display of the object image in accordance 
with the detected characteristics of the touching contact, the recognized, simulated manipulation 
of the object and object information for the displayed object image including data relative to a 
type of the displayed object image specifying physical properties of the object, 

37. (PREVIOUSLY PRESENTED) An apparatus affording simulated manipulation of 
an object in accordance with an image of the object display surface of a displayed on a display 
device, comprising; 

a display device displaying an image of an object; 
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an input device responsive to a touching contact relative to the displayed object image, 
the touching contact simulating a manipulation of the object, and outputting corresponding touch 
information; 

a storage unit storing a plurality of object information, each object information specifying 
a responsive manipulation type of each object; and 

a display controller changing the display of the object image in accordance with the touch 
information and the stored object information specifying a manipulation type of the object which 
specifies physical properties of the object, 

38. (PREVIOUSLY PRESENTED) An apparatus according to claim 37, wherein: 
said storage unit stores an object information specifying that the manipulation type is 

"rollable"; and 

in response to the touch information and said object information, said display controller 
displays the object image in a rolling condition. 

39. (PREVIOUSLY PRESENTED) An apparatus according to claim 37 T wherein: 
said storage unit stores an object information specifying a manipulation type of "elastic"; 

and 

in response to the touch information and said object information, the display controller 
displays the object image in a distortion and/or restoration condition. 

40. (PREVIOUSLY PRESENTED) A method for simulating manipulation of an object 
using a displayed image of the object, comprising: 

displaying an image of an object; 

responding to a touching contact relative to the displayed object image, the touching 
contact simulating a manipulation of the object, and outputting corresponding touch information; 
and 

changing the display of the object image in accordance with the touch information and at 
least one of plural object information, each object information specifying a responsive 
manipulation type of the object which specifies physical properties of the object. 

41 . (PREVIOUSLY PRESENTED) A method according to claim 40, wherein: 

said one of plural object information specifies that the manipulation type is "rollable"; and 
comprises 
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in response to the touch information and said object information, displaying the object 
image in a rolling condition, 

42. (PREVIOUSLY PRESENTED) A method according to claim 40, wherein said 
one of plural object information specifies that the manipulation type is elastic, further comprising: 

in response to the touch information and said object information, displaying the object 
image respectively in a distorted or a restored condition. 

43. (PREVIOUSLY PRESENTED) A storage medium storing a process displaying an 
image of an object by sensing touching contact relative to the displayed object image and 
outputting corresponding touch information; detecting, from the received touch information, 
characteristics of the touching contact, the characteristics including the position on the object 
image of the input touching contact and any changes of the position of the input touching 
contact; and changing the display of the object image in accordance with the characteristics and 
an object information including an object type, which specifies physical properties of the object. 

44. (PREVIOUSLY PRESENTED) A storage medium storing a process displaying an 
image of the object by detecting a position of touching contact relative to the object image and 
any changes of the touching contact and changing the display of the object image in accordance 
with the detected characteristics and object information including at least an object type which 
specifies physical properties of the object and position information which specifies a position of 
the displayed object image. 

45. (PREVIOUSLY PRESENTED) A storage medium storing a process displaying an 
image of an object by sensing characteristics of a touching contact relative to the displayed 
image of the object, the characteristics including at least a position of the touching contact and 
any changes therein, and outputting corresponding touch information representing a simulated 
movement of the object responsive to the characteristics of the touching contact; and 
recognizing a type of manipulation of the object image in accordance with the information 
representing a simulated movement of the object and an object type specifying physical 
properties of the object and, correspondingly, manipulating and displaying the object image, 



9 



Serial No. 09/149,216 

46. (PREVIOUSLY PRESENTED) A storage medium as recited in claim 45, storing 
information specifying a position of a portion of the object being displayed, relative to the whole 
object. 

47. (PREVIOUSLY PRESENTED) A storage medium producing a display of an 
image of an object by sensing touching contact relative to the displayed object image, simulating 
an actual touching contact with an actual object corresponding to the displayed image of the 
object; detecting characteristics of the touching contact including a position of the touching 
contact relatively to the object image and any changes of the position of the touching contact; 
and changing the display of the object in accordance with the object information specifying 
physical properties of the object, and the detected characteristics, 

48. (PREVIOUSLY PRESENTED) A computer readable medium storing therein a 
computer program affording simulated manipulation of an object using a displayed image of the 
object, said computer program comprising: 

a first function of responding to a touching contact relative to the displayed object image, 
the touching contact simulating a manipulation of the object, and outputting corresponding touch 
information; and 

a second function of changing the display of the object image in accordance with the 
touch information and at least one of plural object information, each said object information 
specifying a responsive manipulation type of the corresponding object which specifies physical 
properties of the object. 

49-54. (CANCELLED) 

55. (PREVIOUSLY PRESENTED) A controller for use with a display device to 
manipulate an object displayed on the display device and an input device responsive to a 
touching contact relative to the displayed object and simulating said manipulation, the input 
device producing corresponding touch information and the controller comprising: 

a detector detecting, from the touch information, characteristics of said touching contact 
including the selected location on the displayed object of the touching contact and changes of 
the touching contact and recognizing therefrom the corresponding object manipulation simulated 
thereby; and 
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a display controller controlling to change the display of the object in accordance with the 
recognized, simulated manipulation of the object and object information for the displayed object, 
including data relative to a type of the displayed object which specifies physical properties of the 
object. 

56. (PREVIOUSLY PRESENTED) A controller for use with a display device to 
manipulate an object displayed on the display device and an input device responsive to a 
touching contact relative to the displayed object the touching contact simulating said 
manipulation and the input device producing corresponding touch information; the controller 
comprising: 

a storage unit storing a plurality of object information, each object information specifying 
a responsive manipulation type of each object; and 

a display controller controlling to change the display of the object in accordance with the 
touch information and the stored object information specifying a manipulation type of the object 
which specifies physical properties of the object. 

57. (CURRENTLY AMENDED) An apparatus for use with a display device to 
manipulate an object displayed on the display device, the apparatus comprising: 

an input device responding to a manipulation to the displayed object and producing 
corresponding input information , wherein 

said input device is responsive to a touching contact relative to the displayed object , the 
touching contact simulating said manipulation, and produces corresponding touch information ; 

a storage unit storing object information specifying an object and its center of gravity; 

a display controller controlling to change the display of the object in accordance with the 
input information and the object information specifying physical properties of the object , wherein 

said display controller controls the display of the object in accordance with the touch 
information and the object information . 

58. (CANCELLED) 

59 (PREVIOUSLY PRESENTED) An apparatus according to claim 57, wherein, in 
response to touch information indicating a movement such that the touching contact touches the 
object at its center or its center of gravity, moves and stops while keeping in contact with the 
object, said display controller recognizes the movement as a push manipulation and controls the 
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display of the object so that the object moves from where the touching touches the object to 
where the touching stops, 

60, (PREVIOUSLY PRESENTED) An apparatus according to claim 57, wherein in 
response to touch information indicating a movement such that the touching contact touches 
said object at a position off the center or the center of gravity thereof, moves and stops on said 
touch panel while keeping in contact with the object, said display controller controls the object on 
the display device so that the object moves while rotating from where the touching contact 
touches the object to where the touching contact stops. 

61-70. (CANCELLED) 

71 . (PREVIOUSLY PRESENTED) An apparatus for use with a display device to 
manipulate an object displayed on the display device, the apparatus comprising: 

an input device inputting a manipulation to the displayed object and producing 
corresponding input information; 

a display controller controlling to change the display of the object on the display device 
so that the object moves on the display device from where two touches touch respective, 
opposite sides of the object to where the two touches stop, in accordance with the input 
information indicating a movement such that the two touches touch respective, opposite sides 
of the object and move, 

72. {PREVIOUSLY PRESENTED) An apparatus according to claim 71 f wherein said 
input device is responsive to the two touches relative to the displayed object and simulating said 
manipulation, and outputs corresponding said input information; and 

the display controller controlling to change the display of the object on the display device 
so that the displayed object moves on the display device from where the two touches touch 
respective, opposite sides of the displayed object to where the two touches stop touching the 
object, in accordance with the touch information indicating a movement such that the two 
touches touch the respective, opposite sides of the object and move. 

73. (PREVIOUSLY PRESENTED) An apparatus of claim 72, further comprising: 

a storage unit storing position information which specifies the position where the object is 
displayed on the display device; 
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wherein the display controller, in accordance with the touch information and display 
position information, recognizes a movement such that the two touches touch the respective, 
opposite sides of the object and move, and controls the object on the display device so that the 
object moves on the display device from where the two touching touch both sides of the object to 
where the two touching stop. 

74. (CURRENTLY AMENDED) A controller for use with a display device to 
manipulate an object displayed on the display device and an input device inputting a 
manipulation to the displayed object and producing corresponding input information, the 
controller comprising: 

a display controller controlling to change the display of the object on the display device 
so that the object moves on the display device from where the-two touches touch respective, 
opposite sides of the object to where the two touches stop such touching, in accordance with the 
input information indicating a movement such that the two touches touch the respective, 
opposite sides of the object and move. 

75. (CURRENTLY AMENDED) A method for simulating manipulation of a displayed 
object, comprising: 

displaying an object; 

responding to a manipulation to the displayed object at an input device which produces 
corresponding input information; 

controlling to change the display of the object on the display device so that the object 
moves on the display device from where the-two touches touch the respective, opposite sides of 
the object to where the two touches stop such touching, in accordance with the input information 
indicating a movement such that the two touches touch the respective, opposite sides of the 
object and move- 

76. (CURRENTLY AMENDED) A computer readable medium storing therein a 
computer program affording simulated manipulation of displayed object, said computer program 
comprising; 

a first function of responding to a manipulation to the displayed object at an input device 
which produces corresponding input information; 

a second function of controlling to change the display of the object on the display device 
so that the object moves on the display device from where the-two touches touch the respective, 
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opposite sides of the object to where the two touches stop such touching, in accordance with the 
input information indicating a movement such that the two touches touch the respective, 
opposite sides of the object and move. 

77-82, (CANCELLED) 

83. (PREVIOUSLY PRESENTED) An apparatus for use with a display device to 
manipulate an object displayed on the display device, the apparatus comprising; 

an input device responsive to a touching contact, relative to the displayed object, and 
producing corresponding input information; 

a storage unit storing object information about a large object extending beyond a display 
area of the display device; and 

a display controller, in accordance with the object information and the input information 
indicating a movement such that the touching contact moves a distance more than a 
predetermined distance or the touching contact moves at a speed higher than a predetermined 
speed, controlling to display the object on the display device in a scroll condition. 

84. (PREVIOUSLY PRESENTED) An apparatus according to claim 83, wherein said 
display controller controls to start the scroll condition at a first speed and gradually decreases 
the scroll condition to a second, lower speed, 

85. (PREVIOUSLY PRESENTED) An apparatus according to claim 84, wherein said 
first speed of the scroll condition depends on said speed at which, or said distance at once 
which, said touching contact moves. 

86. (PREVIOUSLY PRESENTED) An apparatus according to claim 83, wherein said 
display controller controls to decrease the speed of the scroll condition in a case where another 
touching contact does not occur. 

87. (PREVIOUSLY PRESENTED) An apparatus according to claim 84, wherein said 
display controller controls to continue the scroll condition in a case where another touching 
contact occurs before the scroll condition steps. 
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88. (PREVIOUSLY PRESENTED) An apparatus according to claim 83, wherein said 
display controller controls to stop the scroll condition in a case where the touching contact stops 
in the scroll condition of the displayed object. 

89. (PREVIOUSLY PRESENTED) A controller for use with a display device to 
manipulate an object displayed on the display device and an input device responsive to a 
touching contact relative to the displayed object and producing corresponding input information, 
the controller comprising: 

a storage unit storing object information about a large object extending beyond a display 
area of the display device; and 

a display controller, in accordance with the object information and the input information 
indicating a movement, controlling to display the object on the display device in a scroll 
condition, such that the touching contact moves a distance more than a predetermined distance 
or the touching contact moves at a speed higher than a predetermined speed. 

90. (PREVIOUSLY PRESENTED) A method for simulating manipulation of a 
displayed object, comprising: 

displaying a part of an object which extends beyond a display area; 

responding to a touching contact to the displayed object, at an input device responsive to 
a touching contact to the displayed object and producing corresponding input information; and 

controlling to display the object on the display device in a scroll condition, in accordance 
with the input information indicating a movement such that the touching contact moves a 
distance more than a predetermined distance or the touching contact moves at a speed higher 
than a predetermined speed. 

91 (PREVIOUSLY PRESENTED) A computer readable medium storing therein a 
computer program affording simulated manipulation of displayed object, said computer program 
comprising: 

a first function of responding a manipulation to a displayed object from an input device 
responsive to a touching contact relative to the displayed object and producing corresponding 
input information, said displayed object extending beyond a display area; and 

a second function of controlling' to display the object on the display device in scroll 
condition, in accordance with the input information indicating a movement such that the touching 
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